1 |
Generalized Quantifiers as a Source of Error in Multilingual NLU Benchmarks ...
|
|
|
|
BASE
|
|
Show details
|
|
4 |
Great Service! Fine-grained Parsing of Implicit Arguments ...
|
|
|
|
BASE
|
|
Show details
|
|
5 |
Multilingual Compositional Wikidata Questions ...
|
|
|
|
Abstract:
Semantic parsing allows humans to leverage vast knowledge resources through natural interaction. However, parsers are mostly designed for and evaluated on English resources, such as CFQ (Keysers et al., 2020), the current standard benchmark based on English data generated from grammar rules and oriented towards Freebase, an outdated knowledge base. We propose a method for creating a multilingual, parallel dataset of question-query pairs, grounded in Wikidata, and introduce such a dataset called Compositional Wikidata Questions (CWQ). We utilize this data to train and evaluate semantic parsers for Hebrew, Kannada, Chinese and English, to better understand the current strengths and weaknesses of multilingual semantic parsing. Experiments on zero-shot cross-lingual transfer demonstrate that models fail to generate valid queries even with pretrained multilingual encoders. Our methodology, dataset and results will facilitate future research on semantic parsing in more realistic and diverse settings than has been ...
|
|
Keyword:
Computation and Language cs.CL; FOS Computer and information sciences
|
|
URL: https://arxiv.org/abs/2108.03509 https://dx.doi.org/10.48550/arxiv.2108.03509
|
|
BASE
|
|
Hide details
|
|
6 |
Can Language Models Encode Perceptual Structure Without Grounding? A Case Study in Color ...
|
|
|
|
BASE
|
|
Show details
|
|
7 |
A Multilingual Benchmark for Probing Negation-Awareness with Minimal Pairs ...
|
|
|
|
BASE
|
|
Show details
|
|
8 |
Does injecting linguistic structure into language models lead to better alignment with brain recordings? ...
|
|
|
|
BASE
|
|
Show details
|
|
9 |
Køpsala: Transition-Based Graph Parsing via Efficient Training and Effective Encoding ...
|
|
|
|
BASE
|
|
Show details
|
|
12 |
Comparison by Conversion: Reverse-Engineering UCCA from Syntax and Lexical Semantics ...
|
|
|
|
BASE
|
|
Show details
|
|
13 |
SemEval-2019 Task 1: Cross-lingual Semantic Parsing with UCCA ...
|
|
|
|
BASE
|
|
Show details
|
|
15 |
Universal Dependency Parsing with a General Transition-Based DAG Parser ...
|
|
|
|
BASE
|
|
Show details
|
|
16 |
SemEval 2019 Shared Task: Cross-lingual Semantic Parsing with UCCA - Call for Participation ...
|
|
|
|
BASE
|
|
Show details
|
|
17 |
A Transition-Based Directed Acyclic Graph Parser for UCCA ...
|
|
|
|
BASE
|
|
Show details
|
|
|
|